Measurement information processing mode switching system

ABSTRACT

Systems and methods of automatically switching measurement information processing modes related to a self-checkout kiosk. In one exemplary embodiment, a method is performed by an electronic device that includes processing circuitry. The method may include detecting, using object recognition, at least one object present in real-time captured imagery. The method may further include, responsive to detecting the at least one object present in the real-time captured imagery, switching measurement information processing modes from a first measurement information processing mode to a second measurement information processing mode.

BACKGROUND

Conventional retail bag racks may sit upon a security scale of aself-checkout kiosk after placement on a scanning scale (e.g., a scalelocated in a scanning or point of sale (POS) area, which may weigh andprice, for example, produce). For individual weighing and pricing ofitems that do not have a standard identifier (e.g., a universal productcode (UPC), a barcode or a quick response (QR) code), the scanning scale(e.g., a bioptic scanner scale that has two scanners and scans in twodirections) may be unnecessary. The scanning scale in the self-checkouthardware can be large, heavy, and expensive to operate and maintain. Inaddition, the scanning scale requires additional space to be provided,and may be inefficient by requiring additional operator action (e.g.,placing the item on the scanning scale). Every square inch is accountedfor in the POS environment and maximized for optimizing the return ofinvestment (ROI).

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure will now be described more fully hereinafter withreference to the accompanying drawings, in which embodiments of thepresent disclosure are shown. However, the present disclosure should notbe construed as limited to the embodiments set forth herein. Rather,these embodiments are provided so that the present disclosure will bethorough and complete, and will fully convey the scope of the presentdisclosure to those skilled in the art. Like numbers refer to likeelements throughout.

FIGS. 1A and 1B illustrates one embodiment of a bag rack in accordancewith various aspects as described herein.

FIGS. 1C and 1D illustrates one embodiment of a bag rack with a bag inaccordance with various aspects as described herein.

FIGS. 2A and 2B illustrate a self-checkout kiosk in accordance withvarious aspects as described herein.

FIG. 3 illustrates an electronic device in accordance with variousaspects as described herein.

FIG. 4 illustrates one embodiment of a method of automatically settingor switching measurement information processing modes related to aself-checkout kiosk and performing the set or switched to measurementinformation processing mode in accordance with various aspects asdescribed herein.

FIG. 5 illustrates one embodiment of performing a measurementinformation processing mode in accordance with various aspects asdescribed herein.

FIG. 6 illustrates another embodiment of performing a measurementinformation processing mode in accordance with various aspects asdescribed herein.

DETAILED DESCRIPTION

For simplicity and illustrative purposes, the present disclosure isdescribed by referring mainly to an exemplary embodiment thereof. In thefollowing description, numerous details are set forth in order toprovide a thorough understanding of the present disclosure. However, itwill be readily apparent to one of ordinary skill in the art that thepresent disclosure may be practiced without limitation to these details.

Self-checkout kiosks are typically designed in such a way as to limitthe size of the self-checkout lanes in order to improve ROI and reduceup-front and maintenance costs. It is desirable for a self-checkoutkiosk or lane to have a reduced size to improve ROI and reduce up-frontand maintenance costs. Accordingly, there is a need for improvedtechniques for performing measurement information processing withregards to POS systems integrated within a retail environment, such asat a self-checkout kiosk or other POS environments. Embodiments of thepresent disclosure relate to systems and methods of switchingmeasurement information processing modes using processing circuitry ofone of the described electronic devices. FIGS. 1A and 1B illustrate anexemplary integrated bag rack 100 for performing the method 400, themethod 500 and the method 600 disclosed herein. The integrated bag rack100 includes a built-in display 101, a retaining wall 103, and abuilt-in electronic scale 105 (an electronic measurement device). Thedisplay 101 is configured to display information regarding an itemplaced on the integrated scale 105. The displayed information providedby the display 101 may include an object characteristic value, such as aweight or quantity, and a determined price. The retaining wall 103 maybe orthogonal to a main surface area of the integrated scale 105. Thedisplay 101 and the electronic scale 105 may be positioned at oppositeends of the retaining wall 103. The retaining wall 103 may be made outof a metal, such as stainless steel, or a plastic. The retaining wall103 may include one or more hooks positioned on the end of the retainingwall 103 that the display 101 is connected to. The retaining hooks maybe configured to hold straps of a reusable bag.

The electronic scale 103, which may be referred to as a produce scale,may include or be connected to a controller (e.g., a memory andprocessor) that records the measured object characteristic and recordsthe measured object characteristic. The scale may also transmitinformation related to the measured object characteristic to the display101 so that the display 101 displays the measured object characteristic(e.g, 0.8 lbs). The displayed information may also include a cost of themeasured item (e.g., 0.8 lbs, $1.60 displayed for an item that is $2.00per pound). In one example, the self-checkout kiosk 200 may include adisplay screen 209 or 209′ that may indicate a total weight as items areput in a bag per bag rack space (e.g., if one integrated bag rack, onescreen block with weight, if three integrated bag racks, three screenblocks with individual weights of each bag rack area).

In one example, the electronic scale 103 (e.g., used to weigh produce)can be located above or below the base of the bag rack 100. Theelectronic display 101 is attached to the bag rack and the bag rack isattached to the digital scale 105. In one example, the electronicdisplay 101 is integrated into a bracket or arm which is attached to theback of the retaining wall 103 of the bag rack 100 and positioneddirectly over the center of the bag rack 100. In one example, theelectronic display 101 and the electronic scale 103 are powered directlyfrom a lane personal computer (PC) and include communication linesconnected to the lane PC. In one embodiment, a battery or differentexternal power source may be used for power. In one example, the scale105 on the bag rack 101 performs two weight-based functions whichinclude security and produce scale (e.g., methods 400, 500 and 600,described herein). As discussed further with regards to method 400below, the processing circuitry of the bag rack 100 can perform theweighing and measurement calculation as a first measurement informationprocessing mode (e.g., a security check measurement informationprocessing mode) and then switch from security to produce scalemeasurement information processing mode when produce is being processedand back to security mode for non-produce items. Processing circuitry ofthe integrated bag rack 100 may include a connection to a POS or anothercomputer to perform communication.

FIGS. 1C and 1D illustrate the exemplary bag rack 100 as describedabove, and further including a bag 107. The bag 107 is illustrated as areusable bag in FIGS. 1C and 1D but may be a disposable bag. Theretaining wall 103 may include bag hooks as shown in FIGS. 1A-1D thatcan be used to detachably connect the reusable bag to the retaining wall103 of the bag rack 100. In another example, the bag rack 100 mayinclude a T-shirt shaped retaining wall 103 that are configured to holddisposable plastic bags.

When a shopper begins their self-checkout transaction, the scale 105 maybe zeroed-out prior to any items being scanned. When a reusable bag isbeing used, it can be positioned on the bagging-scale 105 prior toweighing any produce items.

FIGS. 2A and 2B illustrate exemplary self-checkout kiosks 200 and 200′.The self-checkout kiosk 200 includes a bag rack 100 corresponding to thebag rack 100 discussed above. Although one bag rack with integratedscale is shown in each of FIGS. 2A and 2B, more than one bag rack withintegrated scale may be provided in each self-checkout kiosk.

The self-checkout kiosk 200 includes a scan area 203 where a customercan arrange items and a bagging area 205 where a customer can placeitems after placement on the scanning area 203. The self-checkout kiosk200 also includes a camera 211 that has a field of view 213 on the scanarea 203. The self-checkout kiosk 200 includes a display screen 209 thatcan display a list of items to be purchased, such as scanned items, andother products (e.g., including produce that was identified andweighed), and instructions/prompts for the checking-out customer (e.g.,for arranging the items, for completing payment). The self-checkoutkiosk 200 also includes a light 215 that can be illuminated to draw theattention of store employees (e.g., in the event a security checkfails).

In FIG. 2A, the scan area 203 may include a scanner scale 207 that canweigh and scan items. In FIG. 2B, there is not a scanner scale in thescan area 203′ of self-checkout kiosk 200′. By adding a bag rack 100with the integrated scale 105, the self-checkout kiosk 200 may havesimilar functionality (e.g., security measurement informationprocessing, pricing measurement information processing) as theconventional self-checkout kiosk using less space. In one example,instead of requiring both a separate security scale 217 and a separatescanner scale 207 (as shown in FIG. 2A), the self-checkout kiosk 100′may include a bag rack 100 with integrated scale(s) 100′ that performstwo functions (security check and produce weighing) to replace thescanner scale 207 and security scale 217. In one example, the securityscale 217 may be used by the processing circuitry with the integratedbag rack scale 105. In one example, the self-checkout kiosk includes thescanner scale 207 and the integrated bag rack scale 105. In one example,the self-checkout kiosk includes the security scale 217 and theintegrated bag rack scale 105. The integrated scale 105 may have aquality that meets or is certified for weights and measures standardsrequired for selling weight or measurement based items (e.g., itemshaving a cost based on weight). At whatever cost based on weight and sothe idea was if we already have this piece of technology there

The self-checkout kiosk 200 may also include a security scale 217 and alane PC 219. Although the lane PC 219 may be a desktop PC, anyelectronic processing device (e.g., a tablet, a server, a mobile device)could be used that includes some or all of the processing circuitry asdescribed herein. There may be one lane PC for each self-checkout kiosk,or the lane PC may manage multiple self-checkout kiosks. The securityscale 217 and the lane PC 219 may be configured to perform thefunctionality of the method 500 (the first measurement informationprocessing method) as described herein using the measurement informationretrieved from the lane scale. In an exemplary embodiment, the lane PC219 may be configured to perform the method 400, the method 500 and themethod 600 using measurement information from the scale 105. The lane PC219 may be configured to perform the method 400, the method 500 and themethod 600 using measurement information obtained from the securityscale 217. The security scale 217 may be located adjacent to the lane PC219 and under a bagging area (e.g., where the bag rack 100 sits). Thelane PC 219 may be located under the scanner 207, as shown in FIG. 2Abut also could be located in a different location (e.g., under thesecurity scanner 217).

In FIG. 2B, an apostrophe (’) is used to designate elements of theself-checkout kiosk 200′ that are similar to the self-checkout kiosk andthe functionality includes similar functionality as described aboveunless differences are described herein (e.g., the light 215 and thelight 215′ may have similar or the same functionality). FIG. 2B includesa self-checkout kiosk that may be similar to self-checkout kiosk 200except that self-checkout kiosk 200′ uses the scale of the bag rack 100to retrieve the measurement information (e.g., for methods 500 and 600).

FIG. 3 illustrates an embodiment of an electronic device 300 inaccordance with various aspects as described herein. Electronic device300 may correspond to the lane PC 219 and 219′ described above. In FIG.3 , device 300 includes processing circuitry 301 that is operativelycoupled to input/output interface 305, neural network circuitry 309,network connection interface 311, memory 315 including random accessmemory (RAM) 317, read-only memory (ROM) 319, and a storage medium 321or the like, communication subsystem 331, power source 313, and/or anyother component, or any combination thereof. Storage medium 321 includesoperating system 323, application program 325, and data 327. In otherembodiments, storage medium 321 may include other similar types ofinformation. Certain devices may utilize the components shown in FIG. 3, or a subset of the components. The level of integration between thecomponents may vary from one device to another device. Further, certaindevices may contain multiple instances of a component, such as multipleprocessors, memories, neural networks, network connection interfaces,transceivers, etc.

In FIG. 3 , processing circuitry 301 may be configured to processcomputer instructions and data. Processing circuitry 301 may beconfigured to implement any sequential state machine operative toexecute machine instructions stored as machine-readable computerprograms in the memory, such as one or more hardware-implemented statemachines (e.g., in discrete logic, field-programmable gate array (FPGA),application-specific integrated circuit (ASIC), etc.); programmablelogic together with appropriate firmware; one or more stored program,general-purpose processors, such as a microprocessor or Digital SignalProcessor (DSP), together with appropriate software; or any combinationof the above. For example, the processing circuitry 301 may include oneor more central processing units (CPUs). Data may be information in aform suitable for use by a computer. The electronic processor 112 maybe, for example, a microprocessor, an ASIC, or another suitable CPU. Theprocessing circuitry 301 may include an electronic processor generallyconfigured to execute software instructions to perform a set offunctions, including the functions/operations described herein.

In the depicted embodiment, input/output interface 305 may be configuredto provide a communication interface to an input device, output device,or an input and output device. The device 300 may be configured to usean output device via input/output interface 305. An output device mayuse the same type of interface port as an input device. For example, auniversal serial bus (USB) port may be used to provide input to andoutput from the device 300. The output device may be a peripheraldevice, such as, one or more of: a camera (e.g., image sensor 361), anelectronic measurement device 362 (e.g., a sensor or digital scale), aspeaker, a sound card, a video card, a display (e.g., display screen209, 209′), a monitor, a printer, an actuator, an emitter, a smartcard,a light emitting element 363 (e.g., light 215), another output device,or any combination thereof. For example, the output device may be a setof light emitting elements 363, such as multiple light-emitting diodes(LEDs) while also including a display screen/monitor as discussed inthis specification. The device 300 may be configured to use an inputdevice via input/output interface 305 (e.g., scanner 207 or a keypad orpersonal identification number (PIN) pad that may include a credit cardreader) to allow a user to capture or input information into the device300. The input device may include a touch-sensitive orpresence-sensitive display screen, an image sensor (e.g., a digitalcamera, a digital video camera, a web camera, etc., such as camera 211),a microphone, a sensor, a mouse, a trackball, a directional pad, atrackpad, a scroll wheel, a smartcard, and the like. Thepresence-sensitive display screen may include a capacitive or resistivetouch sensor to sense input from a user. A sensor may be, for instance,an accelerometer, a gyroscope, a tilt sensor, a force sensor, amagnetometer, an optical sensor, an infrared sensor, a proximity sensor,another like sensor, or any combination thereof. For example, the inputdevice may include a mouse and a keyboard. In other examples, otherinput devices may be used, with or without the keyboard and mousecombination.

In FIG. 3 , the neural network 309 may be configured to learn to performtasks by considering examples. The neural network 309 is used formachine learning and a training set may be used to train the neuralnetwork as described herein. In one example, the neural network may beused to update parameters (e.g., thresholds, percentages). For example,the neural network 309 learns how to more accurately recognize or detectproduce/product types or product brands based on a user input asdisclosed herein. In other examples, additional neural networks may bestored in the memory. The neural network may be trained using machinelearning. For example, hundreds of pictures of apples could be used totrain the neural network to learn the basics of what an apple lookslike. The learning may be performed in an ongoing basis with supervisedlearning. For example, next time an apple is detected by the producerecognition camera, a user may be prompted to confirm that the apple isactually an apple, or that multiple apples are apples. Although produce(e.g., apples) are used as an example, other items that are notpre-packaged could be used, such as candy, or spices (size of granularpieces and color range), to train the neural network to identify therespective items. Any transaction based on weight or anothercharacteristic could be recognized using the neural network.

The item could be recognized inside of a bag and scanning would not berequired for this item, and no buttons would need to be touched (exceptpossibly for the training). Also, the scale could be in the bag rack(instead of where the item is placed for recognition). The trainedneural network may be provided on the edge (e.g., a processor in thecamera, in the lane PC, or other processing circuitry). The neuralnetwork may be trained at each store location to be personalized foreach store. A human may be involved for auditing to ensure that thecaptured image is correctly categorized during the training orsupervised learning.

In some examples, the camera can track movement of the target object,and perform the switching from the first measurement informationprocessing mode to the second measurement information processing modeafter detecting the target object has been placed in a bag associatedwith the bag rack attached to the digital scale based on tracking of themovement of the target object.

The network connection interface 311 may be configured to provide acommunication interface to network 343 a. Portions of the network 343 amay be implemented using wired and/or wireless networks such as alocal-area network (LAN), a wide-area network (WAN), the Internet acomputer network, a wireless network, a telecommunications network,another like network or any combination thereof. For example, network343 a may comprise a Wi-Fi network. In other examples, a dedicatedcommunication channel may also be used or in place of the networkconnection interface 311. The network connection interface 311 may beconfigured to include a receiver and a transmitter interface used tocommunicate with one or more other electronic devices over acommunication network according to one or more communication protocols,such as Ethernet, transmission control protocol/Internet protocol(TCP/IP), synchronous optical networking (SONET), asynchronous transfermode (ATM), or the like. The network connection interface 311 mayimplement receiver and transmitter functionality appropriate to thecommunication network links (e.g., optical, electrical, and the like).The transmitter and receiver functions may share circuit components,software or firmware, or alternatively may be implemented separately.

The RAM 317 may be configured to interface via a bus 303 to theprocessing circuitry 301 to provide storage or caching of data orcomputer instructions during the execution of software programs such asthe operating system, application programs, and device drivers. The ROM319 may be configured to provide computer instructions or data toprocessing circuitry 301. For example, the ROM 319 may be configured tostore invariant low-level system code or data for basic system functionssuch as basic input and output (I/O), startup, or reception ofkeystrokes from a keyboard that are stored in a non-volatile memory. Thestorage medium 321 may be configured to include memory such as RAM, ROM,programmable read-only memory (PROM), erasable programmable read-onlymemory (EPROM), electrically erasable programmable read-only memory(EEPROM), magnetic disks, optical disks, floppy disks, hard disks,removable cartridges, or flash drives. In one example, the storagemedium 321 may be configured to include an operating system 323, anapplication program 325 such as methods 400, 500 and 600, a widget orgadget engine or another application, and a data file 327. The storagemedium 521 may store, for use by the device 500, any of a variety ofvarious operating systems or combinations of operating systems.

The storage medium 321 may be configured to include a number of physicaldrive units, such as redundant array of independent disks (RAID), floppydisk drive, flash memory, USB flash drive, external hard disk drive,thumb drive, pen drive, key drive, high-density digital versatile disc(HD-DVD) optical disc drive, internal hard disk drive, Blu-Ray opticaldisc drive, holographic digital data storage (HDDS) optical disc drive,external mini-dual in-line memory module (DIMM), synchronous dynamicrandom access memory (SDRAM), external micro-DIMM SDRAM, smartcardmemory such as a subscriber identity module or a removable user identity(SIM/RUIM) module, other memory, or any combination thereof. The storagemedium 321 may allow the device 300 to access computer-executableinstructions, application programs or the like, stored on transitory ornon-transitory memory media, to off-load data, or to upload data. Anarticle of manufacture, such as one utilizing a communication system maybe tangibly embodied in the storage medium 321, which may comprise adevice readable medium. The computer-executable instruction may beconfigured to cause a processor to perform some of the functionality ofthe methods 400, 500 and 600. The computer-executable instructions canbe stored on a non-transitory computer readable medium storingcomputer-executable instructions that, when executed by processingcircuitry, cause the processing circuitry to:

In FIG. 3 , the processing circuitry 301 may be configured tocommunicate with network 343 b using the communication subsystem 331.The network 343 a and the network 343 b may be the same network ornetworks or different network or networks. The communication subsystem331 may be configured to include one or more transceivers used tocommunicate with the network 343 b. For example, the communicationsubsystem 331 may be configured to include one or more transceivers usedto communicate with one or more remote transceivers of another devicecapable of wireless communication according to one or more communicationprotocols, such as Institute of Electrical and Electronics Engineers(IEEE) 802.11, Code-division multiple access (CDMA), Wideband CDMA(WCDMA), Global System for Mobile Communications (GSM), Long-TermEvolution (LTE), Radio Access Network Architecture of 3G UMTS (UTRAN),Worldwide Interoperability for Microwave Access (WiMax), or the like.Each transceiver may include transmitter 333 and/or receiver 335 toimplement transmitter or receiver functionality, respectively,appropriate to the RAN links (e.g., frequency allocations and the like).Further, transmitter 333 and receiver 335 of each transceiver may sharecircuit components, software or firmware, or alternatively may beimplemented separately.

In the illustrated embodiment, the communication functions of thecommunication subsystem 331 may include data communication, voicecommunication, multimedia communication, short-range communications suchas Bluetooth, near-field communication (NFC), location-basedcommunication such as the use of the global positioning system (GPS) todetermine a location, another like communication function, or anycombination thereof. For example, the communication subsystem 331 mayinclude cellular communication, Wi-Fi communication, Bluetoothcommunication, and GPS communication. For example, a payment card may beslid/inserted at a point of sale (e.g., via a card reader), or a mobiledevice (or card) with NFC may be used to tap for payment. The network343 b may encompass wired and/or wireless networks such as a local-areanetwork (LAN), a wide-area network (WAN), a computer network, theInternet, a wireless network, a telecommunications network, another likenetwork or any combination thereof. For example, the network 343 b maybe a cellular network, a Wi-Fi network, and/or a near-field network. Thepower source 313 may be configured to provide alternating current (AC)or direct current (DC) power to components of the device 300.

The features, benefits and/or functions described herein may beimplemented in one of the components of the device 300 or partitionedacross multiple components of the device 300. Further, the features,benefits, and/or functions described herein may be implemented in anycombination of hardware, software or firmware. In one example,communication subsystem 331 may be configured to include any of thecomponents described herein. Further, the processing circuitry 301 maybe configured to communicate with any of such components over the bus303. In another example, any of such components may be represented byprogram instructions stored in memory that when executed by theprocessing circuitry 301 perform the corresponding functions describedherein. In another example, the functionality of any of such componentsmay be partitioned between the processing circuitry 301 and thecommunication subsystem 331. In another example, the non-computationallyintensive functions of any of such components may be implemented insoftware or firmware and the computationally intensive functions may beimplemented in hardware.

Those skilled in the art will also appreciate that embodiments hereinfurther include corresponding computer programs. A computer programcomprises instructions which, when executed on at least one processor ofan apparatus, cause the apparatus to carry out any of the respectiveprocessing described above. A computer program in this regard maycomprise one or more code modules corresponding to the means or unitsdescribed above.

Embodiments further include a carrier containing such a computerprogram. This carrier may comprise one of an electronic signal, opticalsignal, radio signal, or computer readable storage medium. In thisregard, embodiments herein also include a computer program productstored on a non-transitory computer readable (storage or recording)medium and comprising instructions that, when executed by a processor ofan apparatus, cause the apparatus to perform as described above.

Embodiments further include a computer program product comprisingprogram code portions for performing the steps of any of the embodimentsherein when the computer program product is executed by an electroniccomputing device. This computer program product may be stored on acomputer readable recording medium.

In the present disclosure, systems and methods of performing measurementinformation processing using processing circuitry of one of theabove-described or below described electronic devices. In one example,FIG. 3 illustrates a networked electronic device 300 corresponding to alane PC that performs the methods 400, 500 and 600 disclosed herein.

FIG. 4 illustrates one embodiment of a method 400 of automaticallyswitching measurement information processing modes related to aself-checkout kiosk and performing the set or switched to measurementinformation processing mode using processing circuitry of one of theabove-described or below described electronic devices in accordance withvarious aspects as described herein. In FIG. 4 , the method 400 maystart, for instance, at block 401 where it may include accessingreal-time captured imagery retrieved from a camera (e.g., camera 211 or211′). In the present disclosure, the camera 211 or 211′ maycontinuously capture video in the scanning area 213. At block 403, themethod 400 may include detecting, by the processing circuitry, usingobject recognition, at least one target object present in the real-timecaptured imagery. The detection of the at least one target object mayinclude detecting the at least one target object from a set ofpredetermined target objects. For example, the set of predeterminedobject may be of a certain type (e.g., a produce type, a product brand,or a combination thereof). The target object may be recognized andcategorized, using object recognition, based on a produce type, aproduct type or a product brand, respectively, from among a set ofpredetermined produce types, product types and product brands.

According to an exemplary embodiment, the processing circuitry may use acamera to detect objects (e.g., produce objects) in real-time capturedimagery, and identify a produce type or a produce brand of each detectedproduce object. The produce type or product brand of the target objectcorresponding to an item identifier and a price per objectcharacteristic unit (e.g., a price per weight unit, such as a price perpound). In one example, as produce is placed directly into a bag on thebagging-scale 105, the customer can be prompted to identify the type ofproduce in the bag through inputs on a monitor or display (e.g., displayscreen 209 or display 101), if not by product-recognition technology.Once identified, the bagging scale display shows the total weight andprice of the item. The scale is then reset again and the customer canthen continue to place more produce items into the same bag rack. If thebag is filled and removed, a new bag can make ready on the bag rack theprocess starts over again when the next produce item is weighed andidentified.

In other examples, the item type (e.g., produce type or product brand)is identified by other methods. For example, a stand-alone scale couldbe placed in a produce section, and attached to a barcode printer thatprints out a barcode for weighed produce. The scale could include a userinterface that enables a user to enter a product lookup (PLU) number,PIN code (e.g., a four digit PIN code on a sticker attached to theproduct) or text string, or to tap a button corresponding to an itemtype (e.g., a picture of a banana). With this hardware, the userinterface enables the customer to either punch the number correspondingto the item type in or looks it up. As other examples, a universalproduct code (UPC) or barcode could be used instead of or in combinationwith the PLU. Using the integrated bag rack 100 with the producerecognition camera eliminates the need to perform that step (and henceincreases throughput). In addition, during and after a pandemic, thereis a desire to minimize user touch interactions (e.g., with touch screendisplay devices that provides the touch user interface). As an example,the produce recognition camera may determine that a customer has anorange in his hand. In one example, the orange must be placed on thescale or a table to be identified.

At block 405, the method 400 may include setting (e.g., switching ormaintaining), by the processing circuitry, a measurement informationprocessing mode. For example, block 405 may include switching from afirst measurement information processing mode to a second measurementinformation processing mode. Although two measurement informationprocessing modes are discussed more than two measurement informationprocessing modes can be used (e.g., two or more modes for differentcategories of items). The operations at block 405 may be performedresponsive to detecting the at least one target object present in thereal-time captured imagery from among a set of detectable objects. Forexample, the detecting of the at least one target object may includedetecting a produce type or product brand of an item or object (e.g., anapple) placed or held at a certain location (e.g., in a field of view ofa camera). Blocks 403, 405 and 407 may be performed while accessing thereal-time captured imagery from the camera (Block 401 may becontinuously repeated). That is, the captured imagery may be monitored.The monitoring of the captured imagery may begin based on an activation(e.g., a user pressing a button on the display 101 or 101′ or 209 or209′), and multiple items may be recognized and processed. In someexamples, the trigger to begin method 600 is detection of produce, whenthe produce is placed in the bag, the switch has already occurred toplace the current mode into the produce weight measurement mode (aweights and measures mode). After the produce weight measurement modefinishes processing, the current measurement information processing modecould switch back to the first measurement information processing mode(the security check mode).

The second measurement information processing mode may be different fromthe first measurement information processing mode, as discussed in moredetail below. The first and second measurement information processingmodes process measurement information retrieved from the electronicmeasurement device (e.g., digital scale) in real-time.

The first processing mode is a security check measurement informationprocessing mode that includes performing a security check related actionresponsive to a security check failing. The security check, to performloss prevention, may fail responsive to the measured objectcharacteristic value exceeding a tolerance threshold in comparison withan expected object characteristic value of the target object.

The second measurement information processing mode determines a measuredobject characteristic value of the detected target object present in thereal-time captured imagery. The object characteristic value may includea weight. In other examples, the object characteristic is not limited toweight, and the object characteristic may include at least one of aweight of the target object, a mass of the target object, a volume ofthe target object, an area or the target object, a length of the targetobject, a width of the target object, a number of target objects, or asize of the target object.

At block 407, the method 400 may include performing, by the processingcircuitry, measurement information processing according to a currentmeasurement information processing mode. For example, the currentmeasurement information processing mode is set in block 405 (e.g., thesecond information processing mode that was switched to responsive tothe at least one target object, such as from one or more of the set ofpredetermined objects, being present in the real-time captured imagery).In one example, the processing circuitry may further switch back to thefirst measurement information processing mode after a predeterminedperiod of time after the measured object characteristic value of thetarget object has been determined. In one example, the switch back tothe first measurement information processing mode occurs after apredetermined period of time after the measured object characteristicvalue of the target object has been determined elapses.

The conventional self-check-out technology did not provide thecapability to capture an object characteristic (e.g., a weight) to bepriced, and has not been used for dual measurement purposes. In theconventional technology, to measure an object characteristic value(e.g., a weight) of an item that is priced based on the measured objectcharacteristic, a self-checkout kiosk may include two digital scales: asecurity scale below a bag rack for performing a security check, and aproduct scale. The self-checkout bag rack 100 with integrated weightscale 105 and display 101 (all-in-one display, bagger and weight scale)improves transaction throughput speed by reducing the number of times ashopper has to move an item from, for example, the basket to the scannerscale to the bag rack. With the integrated weight scale 105, the itemcan more efficiently move directly from the basket to the bag rack.Moreover, the scanner scales are big, heavy and costly. One scale may beused for two purposes instead of two scales.

FIG. 5 illustrates one embodiment of a method 500 of performingmeasurement information processing according to a first measurementinformation processing mode. In some examples, the first measurementinformation processing mode is a security check measurement informationprocessing mode that includes performing a security check related actionresponsive to a security check failing. According to some examples, thesecurity check fails responsive to the measured object characteristicvalue being outside of a tolerance threshold in comparison with anexpected object characteristic value of the target object.

For example, the first measurement information processing mode mayinclude using the measured object characteristic information (e.g., aweight) to perform a security check(s). In FIG. 5 , the method 500 maystart, for instance, at block 501 where it may include determining asecurity check mode is enabled. A user operator (e.g., a grocery storeemployee) may have control to enable or disable the security check mode.For example, retailers can turn the security check off during certainpeak times to increase serial throughput. Other security checks couldalso be used (e.g., customer behavior monitoring) without utilizing thescale. At block 503, the method 500 may include performing, by theprocessing circuitry, one or more object characteristic value-basedsecurity checks. Block 503 may be performed responsive to determiningthe security check is enabled. Responsive to the security check modebeing disabled, the security checks (Block 503) and related action(Block 504) are not performed.

Block 503 may include performing one or more object characteristicvalue-based security checks. Block 501 may be optionally used as apre-requisite operation, or block 501 may be omitted (e.g., an always-onsecurity check mode that cannot be disabled). The performing of the oneor more object characteristic value-based security checks may includeverifying a characteristic of a product that was scanned or otherwiseentered for purchase with a same object characteristic value measured bya different electronic device (e.g., a digital scale). For example, ifthe self-checkout kiosk is located in a grocery store, then the itemsfor purchase may include boxed goods (e.g., cereal and pasta), cannedgoods (e.g., soups and vegetables), paper products (e.g., paper towelsand napkins), produce (e.g., fruits and vegetables), prepared foods, andother products. These products (and others) may require different typesof security checks to ensure that the customer is purchasing the correctitems. For example, boxed goods, canned goods, and paper goods, may beweighed to ensure that the customer is purchasing the correct sizes, andto avoid theft (e.g., skip scanning, missed scans, where a customerscans one item but places a different item having a different weight inthe bagging area). As another example, certain produce (e.g., bananasand apples) and prepared foods may need to be weighed to ascertain aprice for the items. As another example, certain produce (e.g.,avocados) may need to be counted (to derive a quantity) to ascertain atotal price of the item(s) based on a price per number. For other goods,computerized security checks may be ineffective or impractical, and suchitems may be passed around any security checks. For example, it may beimpractical for customers to place large, heavy bags of dog food on ascale for security check verifications. As another example, it may beineffective to place very light items (e.g., greeting cards) and/orfragile items (e.g., flower bouquets) on a scale for verification.

Each item for purchase can be associated with a security check categoryin a database of a lane PC. For example, as discussed above, dry goods,such as boxes of cereal or pasta, may be available in different sizes,resulting in different weights. As a result, such dry goods items couldbe associated with a security check category that requires the items tobe weighed to ensure that the item on the list matches the item actuallybeing purchased (i.e., the most-recently scanned or entered item). Inblock 503, each item on the list can be associated with a security checkcategory.

The item to be purchased may be identified based on the item beingscanned in a scanning area of a self-checkout kiosk, based on objectdetection/recognition via a camera above the scanning area of theself-checkout kiosk, based on user input (e.g., a product lookupnumber), or a combination thereof. A lookup operation using the productlook up number can be performed to identify the security check categoryassociated with the identified item to be purchased (block 503). Thislookup operation may be performed while the customer is shopping (e.g.,when entered via mobile device) or after the customer is finishedshopping. For example, when the user approaches a point-of-sale (POS)device and/or indicates to the mobile payment device that he is doneshopping, the scanned or otherwise entered items can be compiled into alist, and a lookup operation can be performed on each item in the listto identify a security check category for each item.

Responsive to the expected object characteristic value (e.g., theexpected weight) of the most-recently scanned/entered/identified item tobe purchased not corresponding (e.g., is not within a threshold value,such as a percentage or number (e.g., within 0.1 lbs)) to the measuredobject characteristic value change (e.g., weight change) as actuallymeasured by the scale, the security check may fail. When the expectedobject characteristic value corresponds or matches (e.g., within thepredetermined threshold value), the security check does not fail, and nosecurity check related action occurs. Responsive to the security checkfailing, in block 505, a security check related action may be performed.The security check related action may include causing the light abovethe self-checkout kiosk to illuminate or flash to alert store employees,and may include transmitting a communication (e.g., an email or textmessage alert to a device of an employee of the grocery store regardingthe security check failure). The security check related action mayinclude displaying or audibly outputting a message, such as “weightsdon’t match from what you scanned” or “please place correct item inbagging area” or another suitable alert or prompt information.

FIG. 6 illustrates one embodiment of a method 600 of performingmeasurement information processing according to a second measurementinformation processing mode. For example, the second measurementinformation processing mode may include using the measured information(e.g., a weight) to determine a sale price of produce that must beweighed. In FIG. 5 , the method 600 may start, for instance, at block601 that includes determining the measured object characteristic value(e.g., a measured weight) of the target object based on the measurementinformation retrieved from the electronic measurement device (e.g., thedigital scale). In one example, block 601 may include determining themeasured object characteristic of the target object based on themeasurement information retrieved from the electronic measurementdevice. In one example, block 601 may include determining a measuredweight of the target object based on the measurement informationretrieved from the digital scale.

In one example, the measurement information retrieved from theelectronic measurement device in block 601 is retrieved after apredetermined amount of settling time has elapsed. The predeterminedamount of time of settling time is at least one second. The producerecognition camera can transmit an alert to notify the scale to beginweighing the produce. The settling time may occur after the scale iszeroed-out. The settling time allows the target object to settle (e.g.,to stop moving around as the target object is placed in the bag, toallow a shopper’s hand to move away from the bag). The settling time isused to provide a more accurate measurement free from interference. Thesettling time can be two seconds.

At block 603, the method 600 may further include determining, by theprocessing circuitry, a price of the target object based on the measuredobject characteristic value (e.g., the measured weight). The determiningof the price of the target object based on the object characteristic(e.g., weight) may include: identifying a produce type or product brandof the target object, from among a set of predetermined produce typesand product brands, by using the object recognition on the real-timecaptured imagery; identifying a price per object characteristic unit ofthe identified produce type or product brand; and determining the priceof the target object based on multiplying the identified price perobject characteristic unit (e.g., the price per weight unit) by themeasured object characteristic value of the target object (e.g., themeasured weight) that is based on the measurement information retrievedfrom the electronic measurement device in real-time.

The method 600 may include one or more security checks, such as those inmethod 500. In one example, because the weight of the item is beingcaptured by potentially the same scale, a range of values may be storedcategorized by item type or product brand. For example, a certain typeof apple may have an expected weight within a range of 0.5 lbs to 1.5lbs. In one example, a security check may be performed in block 603 thatincludes verifying or validating that the recognized target objectcorresponds to what was actually placed in the bag by using the expectedweight range of the identified item. This validation or verificationtechnique allows accurate order generation and avoids a different heavyor light item placed inside of an apple exterior.

At block 605, the method 600 may include updating, by the processingcircuitry, a list of items to be purchased to add an item namecorresponding to a type or brand of the target object in associationwith the determined price and the measured object characteristic (e.g.,the measured weight). According to an exemplary embodiment, theprocessing circuitry may further control a touch screen display todisplay a name of the produce type or product brand of the target objectadded to the list of items to be purchased, and a confirmation button,and receive a user input on the confirmation button indicating that thedisplayed name of the produce/product type or product brand correspondsto the produce/product type or product brand of the target object. Forexample, the touch screen display may be programmed to include some ofthe same display functionality as the display 209 or 209′ of FIGS. 2Aand 2B. The processing circuity may further use a neural network (e.g.,neural network circuitry 309) in the object recognition, and the neuralnetwork learns how to more accurately recognize or detectproduce/product types or product brands based on the user input on theconfirmation button.

Although weight is used as an exemplary object characteristic, otherobject characteristics (e.g., count/quantity, etc.) may be used forpricing of a target object. Additionally, although target object issingular, the target object may refer to more than one item (e.g., threelemons at $0.90 per lemon). In other examples, the measured objectcharacteristic value is not limited to weight or count, and the objectcharacteristic may include at least one of a weight of the targetobject, a mass of the target object, a volume of the target object, anarea or the target object, a length of the target object, a width of thetarget object, a number of the target objects (count/quantity), or asize of the target object.

According to an embodiment, the bag rack 100 with integrated digitalscale and display may be provided as a standalone system. The bag rack100 may be provided in, for example, a produce section of a grocerystore where the bag rack 100 is provided at a different location thanthe self-checkout kiosk. The bag rack may include a processor and aportion of the components of the lane PC. The processor of the bag rackmay perform the method 600. The processor of the bag rack may performaccessing real-time captured imagery from the camera, while accessingthe real-time captured imagery from the camera, detecting, using objectrecognition, at least one target object present in the captured imagery,and responsive to detecting at least one target object present in thecaptured imagery, identifying a type or brand of the at least one targetobject present in the captured imagery, determining a price per weightunit of the identified type or brand of the at least one target objectbased on measurement information retrieved from the digital scale inreal-time, and determining the price of the at least one target objectbased on multiplying the identified price per weight unit by themeasured weight of the target object. The method performed by the bagrack may further include controlling a display attached to the bag rackto display at least one of the measured weight of the target object, orthe determined price of the target object. A label printer may beprovided to print a label that displays the at least one of the measuredweight of the target object, or the determined price of the targetobject.

In one example, the bag rack 100 with integrated scale 105 may belocated away from a POS (e.g., the self-checkout kiosk) or the POS maybe provided via a mobile device. For example, the bag rack 100 may belocated in a produce section of a grocery store. For example, infrictionless check-out that is driven by cameras or to supplement analready-placed online order (e.g., curbside pick-up), a user cansupplement an existing order or begin a new order by adding measurementpriced items (e.g., weight or quantity priced produce). The existingorder may include boxed goods or canned items before and after themeasurement priced item is added. Although customers may not care tochoose between boxed/canned items, customers may want to look at andchoose produce (e.g., fruits and vegetables) to have the correctripeness, size, and shape, and to avoid bruises, etc.

In one example, the bag rack 100 may include processing circuity thatincludes a communication interface so that the scale 105 of the bag rack100 is networked into the POS (e.g., wirelessly or hard connected tofacilitate locating in the produce section). A customer could then enterthe grocery store to pick-up an online order (e.g., cans, bottles andboxes and other items) and use the integrated bag rack 100 (e.g., in theproduce section) to weigh and add produce, which can be married up tothe customer’s previously-placed existing order. The integrated bag rackand scale 100 may provide another benefit of immediately charging acustomer for produce, which avoids the situation of a customerattempting to re-stock produce.

The detailed description above is merely illustrative in nature and isnot intended to limit the present disclosure, or the application anduses of the present disclosure. Furthermore, there is no intention to bebound by any expressed or implied theory presented in the precedingfield of use, background, summary, or detailed description. The presentdisclosure provides various examples, embodiments and the like, whichmay be described herein in terms of functional or logical blockelements. The various aspects described herein are presented as methods,devices (or apparatus), systems, or articles of manufacture that mayinclude a number of components, elements, members, modules, nodes,peripherals, or the like. Further, these methods, devices, systems, orarticles of manufacture may include or not include additionalcomponents, elements, members, modules, nodes, peripherals, or the like.

Furthermore, the various aspects described herein may be implementedusing standard programming or engineering techniques to producesoftware, firmware, hardware (e.g., circuits), or any combinationthereof to control a computing device to implement the disclosed subjectmatter. It will be appreciated that some embodiments may be comprised ofone or more generic or specialized processors such as microprocessors,digital signal processors, customized processors and FPGAs and uniquestored program instructions (including both software and firmware) thatcontrol the one or more processors to implement, in conjunction withcertain non-processor circuits, some, most, or all of the functions ofthe methods, devices and systems described herein. Alternatively, someor all functions could be implemented by a state machine that has nostored program instructions, or in one or more ASICs, in which eachfunction or some combinations of certain of the functions areimplemented as custom logic circuits. Of course, a combination of thetwo approaches may be used. Further, it is expected that one of ordinaryskill, notwithstanding possibly significant effort and many designchoices motivated by, for example, available time, current technology,and economic considerations, when guided by the concepts and principlesdisclosed herein will be readily capable of generating such softwareinstructions and programs and ICs with minimal experimentation.

The term “article of manufacture” as used herein is intended toencompass a computer program accessible from any computing device,carrier, or media. For example, a computer-readable medium may include:a magnetic storage device such as a hard disk, a floppy disk or amagnetic strip; an optical disk such as a compact disk (CD) or digitalversatile disk (DVD); a smart card; and a flash memory device such as acard, stick or key drive. Additionally, it should be appreciated that acarrier wave may be employed to carry computer-readable electronic dataincluding those used in transmitting and receiving electronic data suchas electronic mail (e-mail) or in accessing a computer network such asthe Internet or a LAN. Of course, a person of ordinary skill in the artwill recognize many modifications may be made to this configurationwithout departing from the scope or spirit of the subject matter of thepresent disclosure.

Throughout the specification and the embodiments, the following termstake at least the meanings explicitly associated herein, unless thecontext clearly dictates otherwise. Relational terms such as “first” and“second,” and the like may be used solely to distinguish one entity oraction from another entity or action without necessarily requiring orimplying any actual such relationship or order between such entities oractions. The term “or” is intended to mean an inclusive “or” unlessspecified otherwise or clear from the context to be directed to anexclusive form. Further, the terms “a,” “an,” and “the” are intended tomean one or more unless specified otherwise or clear from the context tobe directed to a singular form. The term “include”, and its variousforms are intended to mean including but not limited to. References to“one embodiment,” “an embodiment,” “example embodiment,” “variousembodiments,” and other like terms indicate that the embodiments of thedisclosed technology so described may include a function, feature,structure, or characteristic, but not every embodiment necessarilyincludes the function, feature, structure, or characteristic. Further,repeated use of the phrase “in one embodiment” does not necessarilyrefer to the same embodiment, although it may. The terms“substantially,” “essentially,” “approximately,” “about” or any otherversion thereof, are defined as being close to as understood by one ofordinary skill in the art, and in one non-limiting embodiment the termis defined to be within 10%, in another embodiment within 5%, in anotherembodiment within 1 % and in another embodiment within 0.5%. A device orstructure that is “configured” in a certain way is configured in atleast that way, but may also be configured in ways that are not listed.

What is claimed is:
 1. A self-checkout system comprising: a camera; anelectronic measurement device; processing circuitry; and memory, thememory storing instructions executable by the processing circuitry thatcause the self-checkout system to: access real-time captured imageryretrieved from the camera; and while accessing the real-time capturedimagery from the camera: detect, using object recognition, at least oneobject present in the real-time captured imagery; and responsive todetecting the at least one object present in the real-time capturedimagery: switch measurement information processing modes from a firstmeasurement information processing mode to a second measurementinformation processing mode, wherein the second measurement informationprocessing mode is different from the first measurement informationprocessing mode, the first and second measurement information processingmodes process measurement information retrieved from the electronicmeasurement device in real time, and the second measurement informationprocessing mode determines a measured object characteristic value of atarget object corresponding to the detected at least one object presentin the real-time captured imagery.
 2. The self-checkout system of claim1, wherein the measured object characteristic value comprises at leastone of a weight of the target object, a mass of the target object, avolume of the target object, an area or the target object, a length ofthe target object, a width of the target object, a number of targetobjects, or a size of the target object.
 3. The self-checkout system ofclaim 1, wherein the first measurement information processing mode is asecurity check measurement information processing mode that includesperforming a security check related action responsive to a securitycheck failing, the security check failing responsive to the measuredobject characteristic value being outside of a tolerance threshold incomparison with an expected object characteristic value of the targetobject.
 4. The self-checkout system of claim 1, wherein the instructionsfurther cause the processing circuitry to: switch back to the firstmeasurement information processing mode after a predetermined period oftime after the measured object characteristic value of the target objecthas been determined.
 5. The self-checkout system of claim 1, wherein thesecond measurement information processing mode comprises: determiningthe measured object characteristic of the target object based on themeasurement information retrieved from the electronic measurementdevice, determining a price of the target object based on the measuredobject characteristic, and updating a list of items to be purchased toadd an item name corresponding to a type of the target object inassociation with the determined price and the measured objectcharacteristic.
 6. The self-checkout system of claim 5, wherein thedetermining of the price of the target object based on the measuredobject characteristic includes: identifying a produce type or productbrand of the target object, from among a plurality of predeterminedproduce types and product brands, by using the object recognition on thereal-time captured imagery; identifying a price per objectcharacteristic unit of the identified produce type or product brand; anddetermining the price of the target object based on multiplying theidentified price per object characteristic unit by the measured objectcharacteristic value of the target object that is based on themeasurement information retrieved from the electronic measurement devicein real-time.
 7. The self-checkout system of claim 5, wherein themeasured object characteristic value comprises at least one of a weightof the target object, a mass of the target object, a volume of thetarget object, an area or the target object, a length of the targetobject, a width of the target object, a number of target objects, or asize of the target object.
 8. The self-checkout system of claim 1,wherein the electronic measurement device includes a digital scale, andthe second measurement information processing mode comprises:determining a measured weight of the target object based on themeasurement information retrieved from the digital scale, determining aprice of the target object based on the measured weight, and updating alist of items to be purchased to add an item name corresponding to atype of the target object in association with the determined price andthe measured weight.
 9. The self-checkout system of claim 8, wherein thedetermining of the price of the target object based on the measuredweight includes: identifying a produce type or product brand of thetarget object, from among a plurality of predetermined produce types andproduct brands, by using the object recognition on the real-timecaptured imagery; identifying a price per weight unit of the identifiedproduce type or product brand; and determining the price of the targetobject based on multiplying the identified price per weight unit by themeasured weight of the target object that is based on the measurementinformation retrieved from the digital scale in real-time.
 10. Theself-checkout system of claim 9, further comprising a display device,the display device displays the measured weight of the target object.11. The self-checkout system of claim 10, wherein the display devicefurther displays the determined price of the target object.
 12. Theself-checkout system of claim 10, further comprising a bag rack, whereinthe display device attached to the bag rack and the bag rack is attachedto the digital scale.
 13. The self-checkout system of claim 12, whereinthe instructions further cause the processing circuitry to: trackmovement of the target object, and perform the switching from the firstmeasurement information processing mode to the second measurementinformation processing mode after detecting the target object has beenplaced in a bag associated with the bag rack attached to the digitalscale.
 14. The self-checkout system of claim 1, wherein the measurementinformation retrieved from the electronic measurement device isretrieved after a predetermined amount of settling time has elapsed, andthe predetermined amount of time of settling time is at least onesecond.
 15. A computer-implemented method comprising: while accessingreal-time captured imagery retrieved from a camera: detecting, usingobject recognition, at least one object present in the real-timecaptured imagery; and responsive to detecting the at least one objectpresent in the real-time captured imagery, switching measurementinformation processing modes from a first measurement informationprocessing mode to a second measurement information processing mode,wherein the second measurement information processing mode is differentfrom the first measurement information processing mode, the first andsecond measurement information processing modes process measurementinformation retrieved from the electronic measurement device in realtime, and the second measurement information processing mode determinesa measured object characteristic value of a target object correspondingto the detected at least one object present in the real-time capturedimagery.
 16. The computer-implemented method of claim 15, wherein themeasured object characteristic value comprises at least one of a weightof the target object, a mass of the target object, a volume of thetarget object, an area or the target object, a length of the targetobject, a width of the target object, a number of target objects, or asize of the target object.
 17. The computer-implemented method of claim15, wherein the first measurement information processing mode is asecurity check measurement information processing mode that includesperforming a security check related action responsive to a securitycheck failing, the security check failing responsive to the measuredobject characteristic value being outside of a tolerance threshold incomparison with an expected object characteristic value of the targetobject.
 18. The computer-implemented method of claim 15, wherein thesecond measurement information processing mode comprises: determiningthe measured object characteristic of the target object based on themeasurement information retrieved from the electronic measurementdevice, determining a price of the target object based on the measuredobject characteristic, and updating a list of items to be purchased toadd an item name corresponding to a type of the target object inassociation with the determined price and the measured objectcharacteristic.
 19. A non-transitory computer readable medium storingcomputer-executable instructions that, when executed by processingcircuitry, cause the processing circuitry to: access real-time capturedimagery retrieved from a camera; and while accessing the real-timecaptured imagery from the camera: detect, using object recognition, atleast one object present in the real-time captured imagery; andresponsive to detecting the at least one object present in the real-timecaptured imagery, switch measurement information processing modes from afirst measurement information processing mode to a second measurementinformation processing mode, wherein the second measurement informationprocessing mode is different from the first measurement informationprocessing mode, the first and second measurement information processingmodes process measurement information retrieved from the electronicmeasurement device in real time, and the second measurement informationprocessing mode determines a measured object characteristic value of atarget object corresponding to the detected at least one object presentin the real-time captured imagery.
 20. The non-transitory computerreadable medium of claim 19, wherein the second measurement informationprocessing mode comprises: determining the measured objectcharacteristic of the target object based on the measurement informationretrieved from the electronic measurement device, determining a price ofthe target object based on the measured object characteristic, andupdating a list of items to be purchased to add an item namecorresponding to a type of the target object in association with thedetermined price and the measured object characteristic.